We study the dynamics of a quantum superconducting circuit which consists of a Josephson charge qubit, coupled capacitively to a current biased Josephson junction. Under certain conditions, the eigenstates of the qubit and the junction become entangled. We obtain the time evolution of these states in the limit of weak coupling. Rabi oscillations occur, as a result of the spontaneous emission and re-absorption of a single oscillation quantum in the junction. We discuss a possible way to experimentally determine the quantum state of the junction and hence observe the Rabi oscillations.